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Abstract. Let M be a monoid (e.g. N, Z, or lP), and A an abelian group. is then a 
compact abelian group; a linear cellular automaton (LCA) is a continuous cndomorphism 
^ : — > that commutes with all shift maps. 

Let /I be a (possibly nonstationary) probability measure on we develop sufficient 
conditions on ^ and ^ so that the sequence {^'^ ^J'}^=l weak*-converges to the Haar measure 
on A^ , in density (and thus, in Cesaro average as well). As an application, we show: if 
A = 1i/p {p prime), ^ is any "nontrivial" LCA on and /i belongs to a broad class 

of measures (including most Bernoulli measures (for D > 1) and "fully supported" iV-step 
Markov measures (when Z) = 1), then iJ^/i weak*-converges to Haar measure in density. 



1. Introduction 

Let Ahea. finite set, and let M be a monoid (e.g. M = Z^, N^, or x N^). Let A"" be 
the configuration space of M-indexed sequences in A. Treat ^ as a discrete space; then 
A!^ is compact and totally disconnected in the Tychonoff product topology. The action of 
M on itself by translation induces a natural shift action of M on configuration space: for 
all e G M, and a e A^, define cr^[a] = [^mLGMi] where, Vm, 6^ = Oe.m, where "." is the 
monoid operator ("+" for M = Z^ x N^, etc.). 

A cellular automaton (CA) is a continuous self-map : A^ — > A!^ which commutes 
with all shifts: for any e G M, ^ o cr^ = cr^ o^. Hedlund |^ proved that any such map 
is determined by a local function f : A^^ — > A, where U C M is some finite set (thought 
of as a "neighbourhood around the identity" in M), so that, for any a = [amLewi] ^ 
with S'(a) = [^mlmeMi] ^ have: 

Vm e M, b^ = f (a|(n,.u)) • 

t This research partially supported by NSERC Canada. 
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If is a finite abelian group with operator "+" , then is a compact abehan group under 
componentwise addition. A linear cellular automaton (LCA) is a CA which is also a 
group endomorphism from to itself. This is equivalent to requiring f to be a group 
homomorphism from A^ into A. An affine cellular automaton (ACA) is one having a local 
map of the form f = () + 6, where f) : A^ — > ^ is a homomorphism, and b ^ A is some 
constant. 

The term "linear" comes from the special case when A — Z/^, for some prime p. Since 
Z/j3 is also a finite field, this map is actually a linear map from the (Zyp)-vector space (Z/p)^ 
into Z/p; it generally takes the form: 

f[a] = ^/,a, (1) 

where a — [flu Leu] element of A^ , and where {/u ; u G U} is a set of coefficients in 

Z/p. 

The Haar measure on A^ is the measure H"^ assigning mass A^^ to any cylinder 
set on N coordinates, where A = Card [A]. TL'"' is ^J-invariant for any LCA raising the 
question: for what measures ji do the iterates ^ := ^ o converge to Ti™"' in the 
weak* topology, as — *■ oo? 

This was first investigated by D. Lind j^, who studied the LCA on (Z/2) with local 
map f(a) = a(_i) + ai. Using methods from harmonic analysis, Lind showed that, if /i is 
any nontrivial Bernoulli probability measure on (Z/2)^, then 

ri=l 

Lind also showed that the sequence of measures ; A S N} does not itself converge to 

Haar measure; for all j G {2" ; n G N} the measure fj, is quite far from Haar. 

Ferrari et al. ^ 10] studied LCA with local maps f(a) = fcooo + kiai acting on A^, 
where A ^ l^/q, q ~ for some prime p, and fco and ki are relatively prime to p, and 
showed Cesaro convergence to Haar measure in the weak* topology for a broad class of 
measures satisfying a certain "correlation decay" property, including most Bernoulli and 
Markov measures. These results are summarized in Q, where the authors also prove that 
most Markov measures on A?' will Cesaro -converge to Haar, when A = (Z/2) © (^/2)i and 
f : A^ — > A is defined f [(a;i,yi), {x2,y2)] = (2/1, xi +y2)- 

These results raise four questions: 

1. Is there some broader class of measures whose 5^-iterates converge to Haar measure in 
Cesaro mean? 

2. Rather than Cesaro convergence, can we obtain convergence in density? (If is 
stationary, then Cesaro -convergence to Tir-^ is equivalent to convergence in density. 
However, when jj, is nonstationary, convergence in density is a stronger result.) 

3. For what other linear CA can we prove convergence to Haar? What about affine CA? 

4. Can these results be generalized to LCA on higher dimensional lattices (e.g. M = Z^, 
N^) or nonabclian monoids such as free groups? 

We address these questions by developing a sufficient condition for the sequence of 
measures {iJ^AiljveN} converge, in density, to Haar measure, where ^ : Jl^ — > Ji^ 
is an LCA, and M is a finitely generated monoid. We require the measure fj, to have a kind 
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of mixing property, called harmonic mixing — we demonstrate that, for example, Bernoulli 
measures (on A^, where M is any monoid) and iV-step Markov measures (when M is Z or 
N) have this property. We also require the automata ^ to have a kind of "expansiveness" 
property, called diffusion^ which we show is true for all "nontrivial" LCA when A ~ Z/p. 

This paper is organized as follows: in we develop background on harmonic analysis 
over A^ (§2^) a-nd linear cellular automata (§2^). In §^ we discuss harmonic mixing and 



exhibit some examples of it. In we discuss diffusion and its consequences. In §^ we show 
that, for any prime p and D > 1, if A = then all "nontrivial" linear cellular automata 

on A^ > are diffusive; hence, such automata take harmonically mixing measures on 
into Haar measure. 



Notation: Elements of A will be written as a, 5, c, ... . We often identify the elements of 
A with the set [0..p) := {0, 1, ... ,p — 1}. Sans-serif letters (e.g. m, n, u, . . . ) are elements 
of M. Boldface letters (e.g. a, b, . . . ) are elements of A^, and a = [amLGMi] • Capitahzed 
Gothic letters (eg. ^J, ©) denote cellular automata. The corresponding lower-case Gothic 
letters (eg. f, g) denote the corresponding local maps. 



2. Preliminaries 

2.1. Harmonic Analysis on A^ Let be the unit circle group. A character of „4 is a 
group homomorphism : A — > . Let A be the group of all characters of A. 
li A = 1,1m then A is canonically isomorphic with A. First define 7 G y4. by 

/27ri 

7(a) = exp a 

V " . 

(where we identify A with [O..71) in the obvious way). Then, for each k E A and a E A, define 
7*^ e by: 7*^(0) :— 7(fc • a) — exp (^A; • a), where "/c • a" refers to multiplication, 
mod n. Then A — {7*^ ; k e y^}, and the map ^ 3 /c > 7^^ G A is an isomorphism. 

Let A!^ be the group of characters of A^. If A is any abelian group, then Ai* is in 
bijective correspondence with the set 



[XmlrnGMi] ^ (-^j ; Xm = 1 for all but finitely many m G 
If [xmlmeMi] such a sequence, then define 



That is: if a = [amLewi] element of then x{^) = W Xm(am), (where all but 



finitely many terms in this product are equal to 1.) The sequence [xmlmeMi] called the 
coefficient system of x- The rank of the character x is the number of nontrivial entries 

in [XmLeMi]- 

For example, if ^ = Z/„, then AJ-"^ is naturally isomorphic to the group 

I [XmLeMi] £ ; Xm = for aU but finitely many m G m| . 
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If [XmLeMi] is such a sequence, then let x = 7^" : — > Thus, if a = [amLGMi] 

is an element of A^, then x(a) = exp | ^^Xm • J • 

Let Ai [A^] be the space of (possibly nonstationary) probability measures on A^. If 
IJ, G M [A^] , then the Fourier coefficients of fj, are defined: 

m[x] = ilJ-^x) = X dn, 
J A" 

for all X G "4^. These coefficients completely identify /U. We will use the following basic 

result from harmonic analysis: 

Theorem 1. ///Xi,/X2,M3) • • • ,Mcx> G-A^ [A^], then 

( thibc] -1:^ V^[x\ for all X e ) <s=^ ( Moo m the weak*-topology ) . 

2.2. Linear Cellular Automata If ^ = Z/„, and f : A^ — > ^ is a homomorphism, 
then there is a unique collection of constant coefficients [./ulugu] G A^ so that, for any 

a = [aul.gu] G A^, we have: f(a) = ^ /uCu. Thus, ifd -A^ — > A^ is the corresponding 

ueu 

LCA, then, V a = [amlmeMi] G A^, S^(a) = /u • <T"(a). In other words, we can formally 

ueu 

write as a "polynomial of shift maps" : 

ueu 

This defines an isomorphism of between the ring of LCA over Al^ and the ring of formal 
polynomials with coefficients in A and "powers" in M. Composition of cellular automata 
corresponds to multiplication of these polynomials. 

Proposition 2. Ifd^ '^f"'^"' ande= "^g^cr", then^o(S= ^ ^ f^g^ a^. 

ueu veV keM yueo,_v€V j 

If 5^ is a linear cellular automata with coefficient system f = [/ulueo]' ^^"-^ x is a 
character with coefficient system % = [xmLeMi] > then define X * f = [^klkewi] ' where, for 
all fc e M, & A\s defined: 

Cfe = (Xm ■ /u) 

m.u=k 

(almost all terms in this sum are equal to 0). Then it is not hard to show: 

Proposition 3. // x G A!^ and ^ : A^ — > A^ are determined by coefficient systems x 
and f respectively, then x°-S is also a character, and is determined by coefficient system 
X * f □ 
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3. Harmonic Mixing 

A measure /i on is called harmonically mixing if, for all e > 0, there is some R > 
so that, for aU x G A^, rank [x] > =^ \Mx] \ < ^ ) ■ (^^otice that this definition 
does not require fi to be stationary.) 

For example, H™"' is harmonically mixing; indeed, for all x except the trivial character 
1, we have: (x, TO^) = 0. 

Let A4 [A^; C] be the Banach algebra of complex-valued measures (with convolution 
operator and the total variation norm ^^'^ let 7i C [^'^;C] be the set of 

harmonically mixing measures. 

Proposition 4. Tl is an ideal of M [^";C] ,, closed under \\»\\^ar- 

Proof: H is clearly closed under linear operations. To show that W is a convolution ideal, 
use the fact that jT*!? — fi-v and that v is bounded by Thus, if /i is harmonically 

mixing, then so are ^l* v and v * ^. 

To show closure in H'll^^j.^, use the fact that, for any measures /i and v, — 1^11^,^^ = 

sup{|(0,M> - (0,1^)1 ; </'e C(^M.c), ll'/'lloo = !}• ° 

Not all measures on A^ are harmonically mixing. For example, m G M, we say 
£ M [A*^] is m-quasiperiodic if there is an orthonormal basis {^„|„£[,} of [A^; fi), 
consisting entirely of eigenfunctions of the shift map cr"^. It is not difhcult to show that, if 
fj, is m-quasiperiodic for any m ^ IdM, then /i is not harmonically mixing. 

Also, if X • A^ — > is a nontrivial character, then the Markov subgroup |l2|, ^ |^ 
induced by % is defined: 



AM 



{aeA^;X° ^"'(a) = 1, Vm e M} 



If A^ is nontrivial, it is a subshift of finite type. If /i is a stationary probability measure on 
A^, then /i cannot be harmonically mixing: if mi,... ,mi<-gM are spaced widely enough 

K 

apart, and ^ := x ° f then (/i, $,) = 1, no matter how large K becomes. 

k=l 

However, /i may still be harmonically mixing relative to the elements of A^; see Corollary 



3.1. Harmonic Mixing of Bernoulli Measures 

Proposition 5. Let A — l^i^, where p is prime. Let [3 he any measure on A which is 
not entirely concentrated on one point. Let f}®^ = p be the corresponding Bernoulli 

meM 

measure on A^ . Then j3®^ is harmonically mixing. 



Proof: Vfc e A, let Ck := (7*^, where 7'^' e ^ is as in §2T, Since p is prime, |cfe| < 1, 



unless fc = 0, while cq = 1. Thus, c :— max \ck\ < 1- Thus, if x G -4** and rank [x] — R, 

0<k<p 



then \{x, Z?^'^)! - 
small as R gets large. 



Y\_ (Xm,/3) < becomes arbitrarily 

meM 

□ 
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A similar argument shows: 

Proposition 6. Let A be an arbitrary finite abelian group, and (3 a measure on A. Suppose 
that, for any subgroup Q C A, the support of fi extends over more than one coset of Q . Then 
is harmonically mixing. □ 

Corollary 7. H is weak* dense in M [A^] . 

Proof: Let e M [A^] be arbitrary. For any e £ [0,1], let ly, = Pf^ e M [J^^] be 
the Bernoulli measure with one-dimensional marginal P^, where /?e[0] = 1 — e, and, for 
a\\ a <^ A \ {0}, /3e[a] = e/{A ~ 1) (where A = Card [A]), e U hy Proposition | so 
v^* fi ^Ti also, by Proposition ^. 

We want to show that "\\iL*mm Vf*ii — ii: it is equivalent to show that lim v7'*~jl = u, 
pointwise. Clearly, wdc*— lim — Sq, where 5o is the point mass on the constant zero 

e— >0 

configuration G A^. Thus, for any x G ^^T^T'l/t) ~ ^tix) ' ' 

5o{x)-Kx) - x{Q)-Kx) = Kx)- □ 



3.2. Harmonic Mixing of Markov Measures Now let M = Z, and suppose that /i is 
a Markov measure on A?', is determined by the transition probability matrix Q = 

^b\abeA ' "^itb stationary probability vector i/ = [t'alag_4], ^^^^ Q ■ i>' = i'. 
Thus, if c G J? is a /i-random configuration, then = Prob [cq — a], and 

g;^ := Prob[ci = 6 | cq = a]. 

Proposition 8. Let A be any finite abelian group. Lf all entries of Q are nonzero, then fi 
is harmonically mixing. 

Proof: Let C-^ be the set of aU functions ^ : A — > C. 
Define the operator Q : C'^ — > C"^ as follows: for any G C"^ and any a ^ A, 

beA 

In other words, Q[^](a) = q"), where q° is the "ath" column of the matrix Q, and 
we treat ^ as an ^-indexed vector. 

Next, for any x ^ A, define the multiplication-by-x operator: A4^ : C"^ — > C'^ so that, 
for any ^ G C"^ and any a G ^, Mx[^]ia) = x(a) • 

Now, suppose X = Xo ® Xi "Xi . . . (X) xn is a character on A^ (in other words, x — Xn> 

nez 

but Xn = 1 for all n > and n < 0). 
Claim 1: 

(a) IfN>l,thcn = (A^xo°Q°-^xi°2°---°-^Xiv-i°2[XJv], • 

(b) For any G C-^ and any x ^ A, \\M^m\oo = ll<^lloc- 

(c) For any iionconstant (f> G C-^ , \\Q[4']\\oo < ll'^lloo- 



Prepared using etds.cis 



Limit Measures for Ajjine Cellular Automata 



1275 



Proof: (a) is just linear algebra, (b) is because, Va G A, 



that, VaGA |Q[0](a)l 



beA 



< 



beA 



ibimi < 



x(a)| = 1- To see (c), note 
sup 10(6)1 = m^. The 

beA 

first (triangle) inequality is an equality if and only if all the elements of {(j){b) ; b G A} 
have the same phase angle. The second inequality is an equality if and only if they all 
have the same magnitude. Hence, |Q[(/'](a)| < H'/'llo^, with equality if and only if is 
constant □ [Claim 1] 



Now, for any ^, C e A with C 7^ 1, define V^x := M^oQcM^oQ. Then V^x : ^"^ — * 
is a linear operator. If C-^ is endowed with the H'll^^ norm, then let ||'P{,clloo 
operator norm of V^x- 

Claim 2: WV^xlL < 1- 

Proof: Let (j> G C-^, with \\<l>\\^ = 1. If </> is not constant, then by Claim |l^, 
< 1; thus, by Claim and Claim 0, \\M^ o Qo Mc o Q[^]\\^ < 
\\Q[(j)]\\^ < 1. li (p is constant, then Ai^ o Q[(f)] is not constant; thus, by Claim 
§, WM^oQoMcoQm^ < l|A^C° SMIL < 11-^1100 = 1- 

is finite-dimensional, so the unit ball B relative to the supremum norm ||»||^ is 
compact; hence 11^ = sup < 1 □ [Claim 2] 



1 00 



Thus, for aU ^, C e A with C 7^ 1, let c^x II^C^clloc ^^'^ ^^t 

C := maxjc^,^ ; C € -4 and C 7^ l| 

Thus, since c^x < 1 for all ^, C; and since A is finite, we conclude that C < 1 also. So, 
given any e > 0, if X is large enough, then < e. 

Now, if rank [x] > ^K, then the product: x = Xo ® Xi ® • • • ® Xn can be rewritten: 

_a «) (6 ® Ci) 1 ■ ■ • 1 I «) (6 ® C2) 

no / \ rii 



where R > K, and, for all r G [0..R), ^r,Cr are successive elements in the list 
Xo,X1t-- ,Xn-i, with (r ^ 1, and where no,ni,... ,nji > 0, so that no + ni + 
. . .+nR + 2R = N. Thus, the operator M^o ° Q° A^xi ° Q ° • • ■ o M^m-i ° Q can be 
rewritten as 
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(Q"° o V^.xi) ° (2"' ° ^6,C2) ° • ■ • ° (2""-' ° 'PuXn.) ° 2""- But then 



< 



< 



(2) 
(3) 



< 
< 



\\nuAL-\\n.x2\L' 



o(Q"«-o7'e,,cJoQ«-| 
■■■■\\Pu,u\\^ 



< e 



(1) by Claim |l^. (2) is a probability measure. (3) \\xn\ 
In summary, if rank[x] > 2R, then < £• 



Corollary 9. Let A and /i be as in Theorem |^ and suppose v is a measure on 
absolutely continuous relative to fj,. Then v is also harmonically mixing. 

dv 1 [a] 

Proof: Let = — — , and suppose first that — — p— Ir is the (renormahzed) characteristic 
d^ /i[aj 

function of some cyhnder set [a] = {b G A?' ; bu = a}, where U = [—U . . .U] C Z and 

a G A^ . Thus V = /i[a], the (renormahzed) restriction of /z to a probabihty measure on 

[a] (that is: v{B) = /i ([a] n B) j [i ([a]) for any measurable B C A^). 

Let X = Xn be a character, and suppose N > U. Let X(_) = Xn ^^nd 



-AT 



N 



X(+) = Xn- Let /ijjjj G A4 [^(^•••°°)] be the projection of ^[^j onto coordinates 

n=U+l 

(U...^) (thus, if b G ^(^-^1, then M[aY[b] = ' • • ■ ■ • ^.'^r^^O- SimiWly, 

let /ij^j' be the projection of /Z[a] onto coordinates (— oo . . . —U). Thus, using the Markov 
property of /i, 

ix,^) = (x(-), M[aj^)- n •(^(+)' 

\u=-U / 

Now, analogous to Claim |l^ of Theorem |[ we have: 



(x(-),M[a]^) = (■^X(-«)°2°-^X(l-«)°2°---° 



M 



X(-u-l) 



where cia^^u) i(_y)th "row" of transition matrix Q, and, in a manner analagous to 

the proof of Theorem pi we can show that 



as rank 



By a similar argument (with reversed time), we can show 



^( + )' '^[a] 



as rank 



^(+) 



This shows that v is harmonically mixing. 
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The case when is simple — ie. a finite Unear combination of characteristic functions of 
cyhnder sets — then follows immediately, via Proposition ^ If (/) € ^{[i] is arbitrary, let 
{<\>n\^^-f^ be a sequence of simple functions converging to in the norm. Let {^'n|„£„} 
be the corresponding measures (all harmonically mixing); thus, {i^nLen,} converges to v 
in total variation norm, so v is also harmonically mixing, by Proposition ^. □ 

Notice that the measure v need not be stationary (and will not be, unless is shift- 
invariant.) 

An A^-step Markov process is analogous to a Markov process, but the probability 
distribution of each letter is dependent upon the previous N letters, and conditionally 
independent of what comes before. When = 0, we have a Bernoulli process; when 
A' = 1, a standard Markov process. In general, an A^-step process is determined by a 
collection of transition probabilities Q = {g^ ; a S y^I" -^), h ^ A\ so that, for each 

a e J^^--^\ ^ — 1. One can then find a (generally unique) stationary distribution v 

beA 

on ^[0-^). 

Corollary 10. Let A be a finite abelian group and let a be an N-step Markov process on 
A, where all elements of Q are nonzero. Then a is harmonically mixing. 

Proof: Let B = A^^"'^\ and consider the standard N -block coding map </) : A^ — > B'^, 
defined: 



, Oi, . . . , Ojv, oat+i, • ■ • , a,2N, • ■ • ) — 



/ 


ai 




Qn+I 


■) 


V 




1 


a2N 





This is an isomorphism of topological groups, and the following diagram commutes: 



A^ 

J 
B^ 



Thus, P = (j)*a is a (1-step) Markov measure, with transition matrix P = PbLbeB 
^\,erei;i-2]^^ Clearly, 
if all entries of Q are nonzero, then, so are all entries of P, and thus, by Proposition ||, (3 
is harmonically mixing. Hence, it suffices to show: 

Claim 1: If (3 is harmonically mixing, then so is a. 



Proof: The isomorphism (f) : A^ 
kx) ■■=Xo<P- Thus, — 



> B^ induces isomorphism (f) : B"^ — > A^ given: 
is an isomorphism, and, for any \ G y^^. 



1. 
2. 



rank 



^(x) > 4rank[x] 



N 
ix, a). 



Thus, if rank [x] is large, then so is rank ^(x) ; then ^0 ^(x), /3y is small, and thus 
so is (x, a) □ [Claim 1] 
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An A^-stcp Markov measure satisfying the hypothesis of Corollary ^ gives nonzero 
probability to all cylinder sets of finite length; we might say it has "full support" . 

The technique of Proposition @ can be used to prove the corresponding result for 



stationary Markov random fields on free groups and monoids [13, 14]. Now, instead of one 
transition probability matrix, there are several: one for each generator of the group/monoid. 
As long as there are finitely many generators, the bound C on the operator norms in the 
proof of Proposition 1^ will still be less than 1, and the same argument can be used to show: 

Theorem 11. Let A be a finite group. Let M 6e a free group or free monoid on finitely 
many generators, and let fi be a stationary Markov random field on so that all entries 
in all transition probability matrices are nonzero. Then fi is harmonically mixing. □ 

4. Diffusive Linear Automata 

Let ^ : A^ — > A^ be a linear cellular automaton. We say that ^ is diffusive if, for every 
nontrivial X £ lini rank[xoi?"] ~ oo. 

n — >co 

For example, let A = l^/p for some prime p. Let M be the free group or free monoid on 
D > 2 generators. Let U C M be a finite subset with at least two elements, so that each 
u G U is a product of at least two distinct generators. It is straightforward to show: 

Jf 7^ /u G Z/p, for all u G U, then the automaton ^ = /ucr" is diffusive. 

ueu 

Unfortunately, linear cellular automata on {^/p) are never diffusive: if ^ is such an 
LCA (e.g. ^ = fo + fi-cr""' + f2- a-'"^), then, for any n G N the LCA S'^''") is simply ^, 
"rescaled" by a factor of (e.g. F = /o + /i ■ ct^p '^i) + /a ■ cr^P '"^)). This follows from the 
Fermat property for the field Z/p. Thus, the polynomial of ^'-p has the same number of 
nonzero coefficients as that of 5^, so ^ cannot "diffuse" along the subsequence {p" ; n G N}. 

This motivates a slight weakening of the concept of diffusion: we say that ^ is diffusive 
in density if, for every nontrivial x G -4'^, there is a subset J C N of Cesaro density 1 so 
that lim rankT^og'^l = oo. 

jei 

Theorem 12. Let A he a finite abelian group, and M a countable monoid. Suppose that 
^ : A^ — > A^ is a linear cellular automata, and suppose that fj, is a measure on A^ that 
is harmonically mixing. 

1. If is diffusive, then ■wic*— lim fj, = Tt""' . 

i— >oo 

2. If S is diffusive in density, then there is a set J C N o/ Cesaro density 1 so that 

1 ^ 

w4c*-lim ^^/i = rt^. T/iws lim — V ^ M = W""- 

i — °o JV— ►oo N ^-^ 

jeJ n=l 

Proof: We'll prove convergence in density, from which Cesaro convergence follows 
immediately. The proof of strict convergence is much the same. 

We'll show that the Fourier coefficients of all converge to zero in density. Weak* 
convergence in density then follows by Theorem]^. So, let x G Then 

(x, r^) = / xd{rp) = / x^r d^i = ((x°r),M) 
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Now, since ^ is diffusive in density, we can find a subset C N of density 1 so that 
lim rank[xo3'-'] = oo. But then, since /i is harmonically mixing, it follows that 

Jim ((xor),M) = 0. 

Now, A is finite and M is countable; thus, is countable, so we can find a "common 
tail set" J C N so that: 



J has Cesaro density 1. 



• For every x G A^, there is some iV > so that JJ^ n [iV..oo) C J. 
l|. Remark 2.6.3, or ||). Thus, for aU x e ^4^, lim ((x o y') , /i) = 0. □ 

The same reasoning applies stationary measures supported on shift-invariant subgroups 
of ^M. 

Corollary 13. Let ^ : A^ — > A^ be as in Theorem^. Suppose that g C A^ is a closed 
subgroup, and pi is a measure supported on Q . Suppose fi is harmonically mixing relative to 
the elements ofQ, and^{Q) C Q. If^ is diffusive (in density), then vjk*— lim = Ttp' , 

where Ti."^ is the Haar measure on the compact group Q (and where convergence is either 
absolute or in density, as appropriate). □ 

To extend these results to affine cellular automata, use the following: 

Proposition 14. Let A be any finite group. Let ^ : A^ — > A^ be an LCA with local 

transformation f : > A. Let c ^ A be some constant, and let © be the AC A with local 

map g : A^ — > A given: g(a) = f(a) + c. 
Let fi be a measure on A^, and let J C N. 

// 'wic*— lim ^J-'/i = Ti"' then vik*—lmi & fi — 

jej j<=J 

Proof: Let co G A^ be the constant configuration whose entries are all equal to c, and, 
Vn e N, let c„ = 5^"(co). Let h„ = Cq + Ci + . . . + c„, and define Sj^ ■ A^ — > A^ by: 
i3„(a) = a + h„. A simple computation establishes: 

VneN, = Sjno^". 

If X £ -^^j then for any a £ A^, we have: x ° ■ftn(a) = x + h„) ~ Kn ■ x(a), where 
Kn — X (hn) is some element of T^. Concisely: x° — Kn ■ X- 

Now, S^^/x converges in density to the Haar measure, in the weak* topology, which is 
equivalent to saying: for every nontrivial character x, there is a subset J C N of density 
one such that hm (x°S'', A^) = 0. 

ie.l 

Now, for any j, (x o m) = (xo%°S'^m) = = 
Kj ■ {x° ■S'' , fJ-}- But \Kj \ ~ 1, and thus. 

Since this is true for each character, we conclude that (5"/i also converges in density to 
the Haar measure. □ 
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5. Diffusion on Lattices 

Say that an LCA ^ on is nontrivial if ^ is not merely a shift map or the identity map. 
If we write 3^ as a polynomial of shift maps, then ^ is nontrivial if this polynomial contains 
two or more nonzero coefficients. 

Theorem 15. Let p he a prime number, and A — Z/p. Let D > 1. Then any nontrivial 
linear cellular automaton on is diffusive in density. 

The proof of this theorem will occupy the rest of this section. We will eventually 
accomplish a reduction to the case when D = 1: hence, the reader may initially find it 
helpful to assume D = 1, and to treat all elements ollP (indicated as vectors, eg. "m") as 
elements of Z instead (indicated as scalars, eg. "m"). It will also be helpful to first work 
through the details of the proof in the special case when p = 2; we will make reference to 
this special case in footnotes. 



We will represent LCA using the polynomial notation introduced in §2.2. It will be 



convenient to write these polynomials in a special recursive fashion. For example, suppose 
D — \, and suppose that go,gi,g2 G [l--p): and £(),£i,£2 G Z. Let Q be the linear CA on 

"■^1 J- n„^^2 Then we can rewrite as: 



defined: Q = gacr " + gicr^ 

(S = go-{^oa'") 



52 cr^ 



where ^ = Id + /icr™i + j^cr™^) , 



(2) 



with TOi — £i 



m2 = £2 — £i, fi= .9o and /2 = gi ^52 (with inversion in the field 



Z/p)|f[ More generally, we have the following: 

Lemma 16. Letgo,gi,... ,gj e [l..p), and £o,£i, 
linear CA on A^^ ^ defined: 



Then © — go ■ (^d ° , where: 



gio- 



,£j G Z , and suppose that is the 

(3) 



gjcr 



(4) 



Id + /icr'^ 



id, for all j G [l--^] 



Id 



her 



(Id + /,,_i^™'^- [Id + /j^™']) 



= --£j^i, and f.j = g:\ -g-j. 



Composing with the shift cr^° and multiplying by the scalar go does not affect the diffusion 
property; hence, it is sufficient to prove Theorem for polynomials like (^. On first reading, 
it may be helpful to assume that J = 2, as in (||). 

By Proposition 0, the powers of the linear cellular automaton ^ correspond to powers 



of the corresponding polynomial. To prove Theorem 15, we will therefore need to develop 
some machinery concerning multiplication of polynomials with coefficients in Z/p, by using 
the classical formula of Lucas Q for the mod p binomial coefficients, which has become 
ubiquitous in the theory of LCA. 



Definition 17. p-ary expansion. Index set.: 



t If p = 2, we can assume that /i = /2 = 1. 
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If n E N, then the p-ary expansion of n is the sequence P{n) = {n^^^}"!^ G [Q--p) , 

oc 

such that n = n'*'p*. 

The index set S{n) of n is defined to be: S{n) = {i e N ; nW ^ O} . 
If m G N, then let [m\p be the congruence class of m, mod p. 



Lucas' Theorem: Let iV, n E N, with p-ary expansions as before. Then 



where we dehne 



1, and 



n 



fe=0 

0, for any > a > 0. 



Write "n <C iV" if n'^l < A^l'l for aU i e N. Thus, Lucas' Theorem imphes: 







If n G N, then the Lucas set of n is the set C{n) := {/c G N ; /c <C n}. 
The following elementary arithmetic observation will be used later. 



Lemma 18. Let m, n2, . . . , ni, G N. // M > 0, and for all i G [1..L] and i > M, n['' = 0, 

L ^ 

= 0. 



( L y 

then, for all i > M + [log^ L] , j n; ] 



(Here, \n~\ G N is t/ie smallest integer such that \n~\ > n.) 

Proof: The "logp" term comes from the fact that, in summing L distinct p-ary numbers, 
there is the possibility of up to logp[L] digits of carried value spilling forward. □ 

With Lucas' theorem, one can obtain expressions for powers of linear automata. For 
example, if / G Z/p, and 5 is the linear automata on defined by ^{x) = x + f ■ cr{x), 
then Lucas' Theorem tell us that 



fee£(w) L 

Next, if TOi, 7712 G Z, and /i, /2 G Z/p, and 5^ is as in then 



E 




E E 

E E ■^('=1 

feieC(Af) fc2G£(fci) 



m2'£2 



mifei+m2fe2 



mifci+m2fc2 



where we define /(fc^.^a) := 



"TV 






>1. 
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A similar argument works in Z^, and for an arbitrary number of "nested" polynomial terms 
of this type. This leads to the following 



Lemma 19. // mi, m2, . . . , rfij e Z,^ , and /i, . . . , /j G Z/p, and ^ is as in (Qj, th 



where: m 



en 

k.m) 

[TOi,m2, . . . ,rnj] , 

{[ki,k2,... , kj] e N"' ; fcj < kj^i < . . . fcz < fci < } , 



(5) 



C-'iN) : 

and, for any such k = [/ci, A:2, . . . , kj], we define 

(k, m) :— fciTOi + ^2775,2 + . . . + kjrhj 

, r N kl fcj_l ^ ^ 



(the dependence on N is suppressed in the notation "/(k) "• j 



Proof of Theorem |15|: It suffices to prove the theorem for polynomials ^ like 
So, suppose ^ is not diffusive in density. Thus, there exists some nontrivial character 
X G A'^^"\ some i? G N, and a subset B C N (of "bad" numbers), of upper density (5 > 0, 
so that, for aU n e B, rank [x o y'] < i?. 

Now, for each n G iP , let pr,,-j : ^ — > ^ be projection onto the nth coordinate: 



pr^(a) = an- Let 7 : A — > be the character introduced in §2.1: 7(a) 



exp . _ Thus, there is a finite subset Q C Z^, and a collection of coefficients 
{Xq G [l..p) ; g G Q} so that x is defined|: 

Thus, if is as in ^ of Lemma |l^, and x is as in (^), then, by Proposition ^, the 
character ^ ° 1?^ has the following expansion^: 

Xo^"" = W n T(x9-/(k) •Pr«k,m)+,l) • (7) 

ijGQ kG£-'(A') 

Note that, for every <f G Q and k G C^{N), the factor 7 (^Xg ' /(k) • pr((k.m)+(f)) 
is nontrivial: /(k) is never a multiple of p, and thus, if Xq is nontrivial, then 
7 (xg ■ /(k) • pr((k,m)+g)) is also nontrivial. Thus, the only way the coefficients 
of the character defined by can be trivial is if two terms of the form 

f In the case when p = 2, we can write this: x(^) = (—1)"?. 
f When J = 2 = p, and D = 1 the expansion is: 

xo5"(x) = n n n (-i)('=i"'i+'=2'"2+9) 

q&Q kiGC(n) fe2e£{fci) 
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7 (x*q- f{k') ■ pr((kMn)+g--)) and 7 (xg • /(k) • pr((k,m)+gl) cancel out, which can only 
occur when 

(k*,m)+<f = (k,m)+q. (8) 
This is an equation of Z)-tuples of integers, and hence, is only true if, for all d G [1...Z?], 

(k* , m) + g^rf) = (k, m) + (9) 
where the subscript "(d)" refers to the c?th component of the -D-tuple. 

The idea of the proof is thus as follows: In order for the rank of the character x^-S^ 
(for e B) to be less than R, most of the terms in the expression (|^) must cancel out; 
this requires a specific kind of "destructive interference" between the the index sets S{N) 
and various translations of S{N) so that virtually all elements (k, g) G C'^ {N) x Q must 
be paired up as in equation (H), so as to cancel with each other. 

Our goal, then, is to show that the equation (||) is hard to achieve, so that, after the dust 
settles, more than R nontrivial coefficients remain. We will show that, the set B (indeed, 
any set of nonzero density) must contain numbers for which sufficient cancellation fails 
to occur. 

Reduction to Case D = 1: In order for cancellation of terms (ie. equation (||)) to 
occur in Z^, equation (^) must be true for every d G [1..-D] simultaneously. Hence, it is 
enough to disrupt the equation in one dimension. Hence, at this point, we can reduce 
the argument to the case when D = 1. We will treat mi, . . . , mj as elements of Z, and 
m = [mi, . . . , mj] as a J-tuple of integers; thus, for any other J-tuple k = [fci, . . . , kj], 
we have (k, m) — fcimi + . . . kjrrij. Likewise, Q will be some finite subset of Z. 



Gaps in the Index set: We will use an ergodic argument to show that any subset 
of N of nonzero density must contain numbers N possessing large "gaps" in their index 
sets: i.e. P[A^] has long blocks of O's terminated by I's. We can then find elements 
fci G C{N) also exhibiting these long gaps. The gap in such a is long enough that 
it is impossible to find some other element (k, g) G C'^{N) x Q so that the terms in the 
expression (k, m) + q sum together to "cancel" the terminating 1 in the gap of S{kl). 

Since there are many of these gaps, there are many such elements fc*, and thus, there 
will be at least {R + 1) distinct I's that remain uncancelled, and thus at least {R + 1) 
nontrivial terms in expression (0), contradicting the hypothesis that rank [x ° S^] < R 
for all N €M. 

We can assume that, when we transformed expression (^ into expression (^), we had 
^0 < ^1 < ■ • • < ij, hence, we can assume that mi,... , mj > 0. Thus, they have 
well-defined Lucas sets, S{mi), . . . ,S{mj). So, to begin, define: 



U 



logp |^Card[5(m,)] | +logp(J) 



r stands for "gap" , and is the size of the gaps we wih require. 
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Let qi be the smallest element of Q, and define 

Qi ■■= {5 - 91 ; ? e q} , and U := \J S {q) . 

qeQi 

Next, let w be the element of [O.-p)'"'''^ defined: w := (0,... ,0, 1). We will be concerned 

r 

with the frequency of occurrence of w in the p-ary expansions of integers. 

Notation: If s = sqSi ... s„ is a string in [0..p)", then we define the frequency of the 
word w in s, denoted by fr[w, s], as 

Card [{i e [0,n- 1] : SiS(i+i)....S(i+r) = w}] 
rr w,s := 

If SjSfi+i) . . . S(j_|_r) = w, we'll say that w occurs at s,. 

Claim 1: For any e > 0, there exists M* such that, for any M > M* , there is a set 
g^{e) C [l...pf so that: 

Card > (1 - e)p^, and, Vg e CW, /r[w,g] > 

Proof: Consider the ergodic dynamical system ^[0..p)'*^, cr^, where H'^ 
is the Haar measure and cr : [0..p)^ — > [0..p)'*^ is the shift action. The set 
|a e [0..p)^ ; a[o...r] = has measure p~^~^. The result now follows from Birkhoff's 
Ergodic Theorem □ [Claim 1] 

S 1 6 If 

In particular, let e := — . Also, let e* := W"°'(w) = p~^~^ . 

2p 2 2 

Claim 2: There exist M and N such that the following conditions are satisfied: 

1. Me*>R + 2, 

2. Uc[0,Me*], 

3. N eBn[0,p^), 

4. fr[w,N] > (l-e)p-i-'^. 

Proof: B has upper density 5, so there is some sequence {nk}'^Q such that. 

Card [B n [0, rife]] ^ ^ 

T.. , , . , Card [B n [0..nfe]] (5 ^, , 

tmd K so that, for fc > A, > -. Then choose M large enough to 

rife 2 

satisfy [1] and [2], and such that p^''^ <nk<p'^. Thus, 

Card [in [0,p^]] > Card [Bn[0, rife]] > ^ > 

> -1^- (10) 
~ 2p ^ ' 
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Also, by Claim |l|, let M be large enough so that there is a subset {e) C [0..p)*^ so 
that 

Card[C(e)] > = (11) 

and /r[w,a] > (l-e)p-i-^, for all a G ^^^(e). 

Now, if G := {ne fl../^] ; P(n) G ^^*^(e)}, then Card [G] = Card [e;4^(e)] . Thus, 
combining (0) and (y), we see that Card [B n [O,/^]] + Card [G] > hence, the 

two sets must intersect nontrivially. Let G B n [0,p^^] n G; then N satisfies [3] and 
[4] □ [Claim 2] 

Claim 3: Let Q — [Me*]. Then w occurs more than R times in the string: 

(^N^Q+n ]\[lQ+2] ]\ilQ+3] ...TvM). 

Proof: N satisfies condition [4] of Claim ^, and of course w occurs at most Q times 
in the string (iV° A^I^l . . . N^'^^). Thus, beyond position Q, w must occurs at least 

((1 - e)p-^-'^M) - Q > ((1 - e)p-^-'^Al) - Me* - 1 

= M^—^p-^-'^ - 1 = Me* - 1 



times and so, by condition [1] of Claim 1, at least R+1 times □ [Claim 3] 

Say w occurs at some positions N^^^\ N^^'^\ ... ^Af[J«+il beyond Q. Thus, for each 
r G [1...R + 1], we have: aI^+'^I = for < /c < F and iVlJ-'+^l = 1. In particular, 

Vr G [l...i?+l], p^^'+'^ eC{N). (12) 

Now, A^ G B, so rank [x o g'^] < R. This means that in the expression (0), all but at 
most R of the terms are cancelled by a like term. In other words, for all but R of the 
elements: {'k*,q*) G C''{N) x Q, there exists some {k,q) G jC'-^{N) x Q so that 

(k*, m) + q* = (k, m) + q. (13) 

— we say that (k* ,q*) is annihilated by (k, q) . 

However, there are R + I elements in the set {jr}^J^i, and thus, there are R+1 pairs of 
the form {'k*,qi), where k* = 0, ... ,0). Hence there exists some r such that 

the pair (k*,(7i) is annihilated by some other pair (k, g). Define n :— jr + L; then 
(k*, m) = TOip", so we can rewrite ( |l^ ) as: 

mip" = (k,m) + (q-qi), (14) 

where k = [fci , . . . , kj] is some other element in ( A^) . 

Claim 4: For all j e [I..J], and all i > n -T, we have: k/'^ = 0. 
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Proof: First we'll show = for i > n. The RHS and LHS of (|l^ ) must come from 
different terms of the expansion (|^), which means that either q ^ qi ot kj ^ for some 
J > 1 ; either way, one of the other terms on the RHS is positive besides ^^m\k\ \ and 
therefore, mxkx < mip". Thus, fci < p", and thus, fc['' = for all i > n. 

Next we'll show for n — F < i < n. Recall that fci £ ^(N), and by hypothesis, 
A^H = for aU i e [>•••(> + T)), where n = > + F and n - F = >. Thus, ki^"^ = for 
n — T < i < n. 

Since kj <^ -C . . . <C fc2 ^ fci, the same holds for k2, . . . ,kj □ [Claim 4] 

Claim 5: For all j e [1..J], and alii > n - 2 - logp(J), we have: [m^kj)^'-^ — 0. 
Proof: Fix j G [1..J]. For any s e S{mj), it follows from Claim ||that 

/ Isl \ W 

( rrij p^kj 1 =0, for alH > n — F + s. 

Hence, by Lemma ^ 

ysG5(mj) y 

= 0, Vi > n-F + max[5(mj)]+logp(Card[5(mj)]). 



The claim now follows from the definition of F □ [Claim 5] 

Claim 6: For alii >n -3, {q-qip=Q. 

Proof: By definition, n — 3 >n-T=jr>Q> Me*. Recah that condition [2] 
defining M was: U C [0, Me*]. Thus, {q - gi)^ = for i > Me* □ [Claim 6] 

Claim 7: For alli>n- 1, ((k, m) + {q - qi))''' = 0. 

Proof: Recall that (k, m) = (fcimi) + . . . + {kjmj); thus, it follows from Claim ^ 
and Lemma ^ that (k, m)'*' = 0, Vi > n - 2. 

Thus, the claim follows from Claim ^ and Lemma 18 □ [Claim 7] 

Now, by hypothesis, (k, m) + {q — qi) = mip". Hence, ((k, m) + (q — <Zi))'*' 
= (toip")[*1 for all i e N. In particular, if / := niin [iS(mi)] > 0, then 

((k,m) + = (mip")[^+"l = m['^ + 0. 

But / + n > n, so this is a contradiction of Claim |^. □ 

Conclusion 

We have shown that harmonically mixing measures on when acted upon by diffusive 
linear cellular automata (possibly with an affine part), will weak*-converge, in Cesaro mean, 
to the Haar measure. This sufficient condition is broadly applicable: in particular, if 
A = 'Zi/p, then any nontrivial linear cellular automata acting upon a "fully supported" A^- 
step Markov measure (in Z, a regular tree, or a free group) or a nontrivial Bernoulli measure 
(in Z^) will converge to Haar in Cesaro mean. 
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In a forthcoming paper Q , we generahze the results on diffusion to the case when A ~ 'Z/n 
(n G N arbitrary) and A — (Z/jpr))"^ (p prime, r,J ^ N), and we demonstrate harmonic 
mixing for Markov random fields on , for D > 2. However, many questions remain 

unanswered. What other classes of measures on Z or are harmonically mixing? Measures 
on A^ exhibiting quasiperiodicity cannot be harmonically mixing; what is the Cesaro limit 
of such a measure, if anything? Also, what LCA are diffusive, when M is neither a lattice 
nor a free group? 

Acknowledgments: We would like to thank David Poole of Trent University for 
introducing us to Lucas' Theorem, and Dan Rudolph of the University of Maryland for 
reminding us that, for stationary ^, Cesaro convergence to 7i"^ is equivalent to convergence 
in density. 
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